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I. INTRODUCTION 



Background ; Important changes are taking place in the teaching 
techniques and the content of elementary school mathematics . 

Deans (1963) believed these changes to he the result of (l) rapid 
advances in the knowledge of mathematics, (2) a need for better 
articulation between grade xevels, (3) a “eed for better under- 
standing of the structure of mathematics, and (4) a need for dif- 
ferentiation in mathematics programs to provide for children of 

varying ability. 

This reconsideration of the elementary school mathematics 
program has brought at least two questions to the attention of 
elementary school principals and supervisors, (l) Are the teach 
ers in their school district competent, both in content and meth- 
odology, to present a comprehensive program of mathematics? (2) 
Are the parents of the children in their schools informed about 
the changes which will be necessary before a new program can be 
established? Many administrators have taken steps to secure 
positive answers to these questions. They have provided in 

V 

service education for teachers; they have encouraged continuing 
education and summer school participation; and they have estab 
lished evening classes in mathematics for parents. 

Should a state university share the responsibility for up- 
grading instruction in elementary school mathematics? Just how 
does a university see the problem of educating thousands of 
parents? Obviously, any university would find it next to Imios- 
sible to find enough help for the local schools if they all asked 



for It at once. The supply of professional persons vho can vork 
with teachers is limited, and few universities could provide 
enou^ assistance if every district wlsheci to hold its own work- 
shops. The Continulne Education Staff of the Pennsylvania State 
University believed that a course designed for teachers and broad- 
cast over educational television would reach teachers in every 
district within its viewing area. School districts who want an 
in-service program could then recommend such a coursa for the 
teachers in their school. Parents seeking information about 
changes in mathematics instruction could also audit the course 
snd Xsflrn with tlic tss^clisrs • 

The Pennsylvania State University operates Station VfPSX-TV, 
an educational television station which serves 22 central Pennsyl- 
vanic counties. Through the correspondence department of con- 
tinuing education, the Department of Elementary Education of the 
College of Education offered over WPSX-T7 El. Ed. 1^26, Teachin g 
Modern Mathematics , a three-credit course emphasizing new methods 
and new content for elementary school mathematics. The course 
could be taken either for undergraduate or for graduate credit. 
This 15-week course was presented in h'y half-hour broadcasts, tto 
each week for lectures a demonstrations and the third one for 
questions and answers. The correspondence department provided 
textbooks and a study guide. The students completed fifteen as- 
signments, each cons -.sting of two lessons per week from txie study 
guide, and returned the assignments to the correspondence depart- 
ment for correction. The midterm and final examinations were 
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proctored by local school supervisoia who returned the examination 
papers to correspondence officials for correction. 

Related Studies ; Television as a Medium for In»service Education. 
The value of television as a method of bringing in-service educa- 
tion to teachers has been supported in a number of investigations. 
Some of these researchers used commercial outlets, some reported 
educational channel broadcasts and some had operated on closed cir- 
cuit transmission. Althou^ several of the studies supported tel- 
evision as an effective method of teacher in-service education, 
this support was generally based upon two methods of evaluation; 

(l) achievement tests to measure the learner’s growth in subject 
matter and (2) attitude scales to determine how the subjects felt 
about their experiences. 

Hunt (1961) presented 15 half-hour television broadcasts on 
individualized reading methods over a commercial station in cen- 
tral Pennsylvania. He selected 213 elementary teachers, half of 
whom viewed the broadcasts and half who did not. He used three 
techniques to evaluate the effectiveness of the broadcasts on the 
teachers' classroom behavior; (l) four post-treatment obser- 
vations of the teachers in the classroom, (2) a Teacher * s Attitude 
toward Teaching Reading Scale , and (3) a Teacher's Self Report on 
Teaching Reading . He also measured parents ' and pupils ' attitudes 

towards reading. 

Hunt's conclusions were as follows; 

1. The experimental treatment positively affected the 

observed classroom perf ormsuice of the viewing teachers . 
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2. The experimental treatment 

teachers' attitudes toward individualized readi g. 

3. The experimental treatment had a ®^8nif^ant 

on what teachers reportea they were doxng in teaching 

reading. 

The experimental treatment had a significant positive 
effect on the attitudes of viewing parents. 

5 The experimental treatment had no 

^!e effect on children's achievement in reading 

or on their attitudes toward reading. 

Although Hunt's study supports the effectiveness of television 
■broadcasts on in-service education, his dependence upon self report 



ing instruments alone leaves the real outcries of the study open 
to some question. The classroom observations were made after the 
broadcasts, and since there were no pre-treatment visits it was not 
possible to reach any objective conclusion that the teacher's be- 



havior changed after viewing the programs . 

Devault, Houston, and Boyd (1962) experimented with approxi- 
mately 100 elementary teachers in the Dallas, Texas, area. Using 
content prepared by a research team, the researchers presented 
their in-service education ideas to teachers in four ways: (l) 

®iey broadcast 2lv half-hour television programs of in-service math- 
ematics instruction over an educational television station, (2) 

The same person who presented the television broadcasts gave face- 
to-face lecture-discussion - 12 hour-and-a-half sessions every 
other week, (3) They offered television with consultant servlceo, 
in which the viewing teacher received visits per teacher) and 

assistance with her teaching, and (4) They provided face-to-face 
lecture-discussion with consultant (lf.95 visits per teacher) service 



The researchers used three achievement tests to measure im- 
provement in teacher understanding of mathematics and teacher 
understanding of methods. The conclusions of this study were as 
follows : 

First, t(Jlevision was as effective as face-to-face lecture- 
discussion in changing the mathematics and methods under- 
standings of teachers, in the reactions of teachers to the 
in-service education program, in changing all hut one of 
nine components of the classroom practices of teachers, and 
in changing the mathematics achievement and interest of 
pupils in classes of participating teachers. Second, con- 
sultant services as a supplement to television and face-to- 
face lecture-discussion made a significant contribution in 
some situations. That is, consultant services resulted in 
more favorable reactions from television teachers; they re- 
sulted in greater mathematics achievement among hetero° 
geneous pupils; and they resulted in greater general mathe- 
matics achievement of pupils of television teachers but not 
of pupils of face-to-face lecture-discussion teachers. 

Thus, hypothesis number one: There is no difference in the 

effectiveness of television and face-to-face lecture-dis- 
cussion as media for in-service education of intermediate 
grade teachers of mathematics - is accepted. 

Hypothesis number two: There is no difference in the ef- 

fectiveness of in-service education program presented by 
television or face-to-face lecture-discussion which are sup- 
plemented with consultant services as compared to those in- 
service education program without such consultant services - 
is rejected. 

The first conclusion by DeVault and others (1962) cannot be 
accepted as stated above. Hypothesis number one states only -uhat 
there was no difference in the effectiveness of television and 
face-to-face lectures -discussion as media for in-service education 
of intermediate grade teachers of mathematics. To say that one is 
as effective as another overlooks a number of other variables, any 
of which ml^t be operating to influence the behavior of teachers. 
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The researchers prohahly should have reported only that the two 
sets of scores were not different from each other. 

The results of this study, however, were measured by achieve- 
ment tests of teacher and pupil knowledge. Any changes In teaching 
behavior which might have resulted from the various treatments used 

with these teachers were not reported. 

Wlttich (1961) studied the effectiveness of a series of ItS 

kinescoped television programs each 28 l/2 minutes long, designed 
for in-service teacher education to promote attitudes favorable to 
audiovisuals and to Improve teaching practices in the use of audio- 
visuals. Wlttich used four specially-constructed scales to deter- 
mine the effect on actual day-to-day classroom practices, shifts in 
teachers' attitudes toward AV materials and techniques, teachers' 
opinion of the course, and the impact of the course on the teacher 

for whom it was intended. 

Wittich reached the following conclusions: 

1 The AV - TV course exerted a small hut significant 
positive effect on AV utilization in the classroom. 

p, Althou^ the teachers initially held a favorable 

attitude toward all the AV concepts listed, a post- 
course scale showed improvement in attitude toward 
several of these concepts. 

3. The teachers’ comment on the AV - TV course was 
favorable to the course . 

Althou^ one can agree that the conclusions of this investi- 
gation are Justified hy the nature of the treatment, the study 
failed to produce evidence that teachers made any changes in their 
own classroom use of audio-visual materials. 
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Garry and Maxirlello (i960) divided ^5 fifth grade teachers 
whose classes were about to receive television Instruction In 
French Into two categories: (l) fluent and ( 2 ) non-fluent speakers 

of French. These teachers were randomly assigned to four dif- 
ferent treatment groups: 

1 . Those who viewed a televised teacher training 
program on French Instruction and used tape re- 
cordings as practice materials with their classes. 

2 . ^ose who viewed the television programs^ but who 
themselves planned the practice sessions with 
their classes. 

3. ^ose who practiced with tape recordings to Improve 
their own fluency and used tape recordings with 
their classes. 

U. Ihose who practiced with tape recordings to Improve 
their own fluency and planned their own practice 
sessions with their classes. 

Specially constructed listening tests were used to measure 
the results. The researchers reached the conclusion that the 
method of presentation to the teachers made little difference In 
the level of skill and understanding they reached. The researchers 
reported after a year's study that television Instruction alone with 
out appropriate follow-up practice Is largely Ineffective. 

To determine the relative effectiveness of four methods of In- 
service education In the use of radio and television in the class - 
rooai, Glasgow (no date given on publication) worked with 18I ele- 
mentary and secondary teachers and their pupils to determine which 
of the following methods gave greatest support to the broadcasts: 

1 . Workshops for teachers 

2 . Supervisory visits 

3. Use of special printed material 

i. Use of films and recorded tapes 
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Glasgow found that none of the four investigated factors proved 
superior to any of the others or to any conhination of them. The 
teachers expressed a preference for the workshop method hut they 
also recognized a need for a diversified method of in-service in- 



struct! on. 

The researcher used pupil-achievement tests and teacher- 
opinion surveys as evidence of program effectiveness. There was 
no systematic observation of changes in teacher behavior resulting 
from the different treatments. 

pollis (no date given on publication) sought answers to four 
questions about the use of closed-circuit television for making 

Observations of pupils in the classroom. 

1. As viewed over closed-circuit television, did the 
classroom seem to be a natural setting? 

2 Were the audio and video systems effective in pro- 
viding the emotional feel of the classroom? 

3 Were the viewing sessions conducive to clear ob- 
servation and good discussion? 

k Were the television viewing sessions a valuable 
* additional medium for in-service education? 

The subjects for the study were 20 principals and educators, 
ao teachers, and two professors of education. The consensus of 
these persons was favorable to the potential of television as a 
method of observing the classroon behavior of teachers and stu- 
dents. However, the researcher reported only the teachers' 

opinions as the bases for his evaluations . 

Frazier and Evans (i960) presented ten half-hour telecasts on 

elementary science topics approved by 151 teachers of third and 
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of the study was to explore the 



fourth grade classes. The purpose 
effectiveness of the television programs in increasing teacher 
understanding of elementary science and in stimulating pupil ac- 
tivity in this field. 

The investigators reached the following conclusions ; 

1 . Teachers significantly increased their feelings of 
competence in teaching science in the classroom. 

2 . Teachers expressed a willingness to accept such 
help in other curricular areas. 

3. Teachers evaluated the programs as having a hlgpi 
pupil interest and reported significant growth 
in problem solving behavior. 

I4.. Pupil growth as measured by use of a standardized 
test was not significant. 

The studies cited in the foregoing discussion appear to sup- 
port a wider use of television for the in-service education of 
teachers. A number of them report significantly better performances 
on the part of teachers who have taken part. With the exception of 
Hunt (1961), however, the investigators used only tesw results, 
rating scales, questionnaires or opinion samples to reach their con- 
clusions about te 3 .evision as an in-service medium. The true measure 
of a teacher’s effectiveness is how that teacher performs in the 
classroom, and the only way to study a teacher’s performance is to 
make systematic observations of day-to-day lesson presentations. 

Systematic observations of teacher behaviors require a special 
kind of instrument for recording and quantifying teacher-pupil inter 
actions. Such techniques had been in use for a number of years, 
and a number of published studies could be found which offered 
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assistance to anyone wishing to study teacher behaviors. (See 
pp. 12f) For example, from 1955 to the early 1960‘s, Medley and 
Mitzel (1963) had developed and standardized classroom observation 
instruments. Such instruments migpit have been employed if any of 
the researchers had been interested in behavior changes in the 
cle^srooms of teachers involved in their studies. 

Althou^ Hunt (1961) did make classroom observations, all of 
his visits took place after the teachers had received the television 
treatment. Hunt did not make use of a systematic observation 
schedulej he reported no visits prior to the treatment period; and 
he offered no objective evidence that changes actually occurred. 
Purpose of the Study ; The foregoing review of studies related to 
educating teachers by teJevision broadcasts has left unanswered a 
persistent and very critical question. Will teachers change their 
mathematics teaching behavior while they are taking a college -credit 
television course in the teaching of elementary mathematics? If 
this question could be answered affirmatively, educational televi- 
sion services then should be extended to provide such courses for 
all teachers in a viewing area. If, however, no changes can be 
identified, then those who direct program planning should exercise 
caution in scheduling broadcasts of this nature. 

Statement ai Problem ; The investigator undertook this study to 
secure new information about teachers and the circumstances under 
which they change their teaching behaviors. The specific problem 

to be researched was: 
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Will changes in the mathematics teaching behavior of 
intermediate grade teachers recorded while they are 
taking a fifteen-week television course in teaching 
mathematics differ from the changes made by other 
intermediate teachers who were not taking such a course? 

II. METHOD 

Design for the Study . The investigator assisted Buck (19^7) 
selecting a number of teacher activities which mi^t occur while 
a teacher was instructing an intermediate grade mathematics class. 

He included motivating strategies, contributions by teachers, and 
learner reactions, both verbal and physical. From these elements of 
classroom behavior Buck prepared an evaluative instrument which he 
named the OScAR (EM). (Observation Schedule and Record, Elementary 
Mathematics) The purpose of the OScAR (EM) was to permit an ob- 
server to visit a mathematics class and to leave it with an object- 
ive report of the teaching behaviors which occurred during the visits. 

Any study of behavior changes requires an evaluation of pre- 
treatment, or threshold behaviors as well as an appraisal of those 
which might result from the treatment. Trained observers, using the 
OScAR (EM) made seven threshold visits to the experimental teachers 
(those viewing television lessons) and 23 visits to the same teachers 
during the viewing period (after the broadcasts began) . An equal 
number of threshold visits were made to control teachers (those not 
viewing televisions lessons) and each control teacher was visited 

23 times during the broadcasts. 

The television course was Elementary Education 426. Teaching 
Modem Mathematics , taught by the investigator on Station WPSX - TV 

11 
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from Pe^.ruary 8 to Hay 27, 1966. The course consisted of instruc- 
tion in methods of teaching mathematics to elementary school pupils. 

The observers vho visited the classrooms Included seven ex- 
perienced persons: teachers, supervisors, administrators and college 

instructors who had received training in the use of the OScAR (EM). 
Their visits consisted of a scheduled twenty-minute period during a 

regular mathematics class. 

preliminary work with the OScAR (EM) indicated that teaching 
behaviors In Intermediate grade methematlcs classes can be classified 
into eight different kinds of teacher-pupil Interaction. The OScAR 
was therefore divided Into eight scales, each of which appeared to 
measure Independent elements of teacher performance. 

Threshold observation visits to teachers who were classified 
experimental and control began several weeks before the television 
course broadcasts began. The observers continued to make obser- 
vations of both groups of teachers after the experimental teachers 
had begun working on the lessons. The control teachers did not view 
the broadcasts or In any way take part In the television course. 

In brief, the design of the study was as follows: 

1 To follow up a course In elementary 
mathematics methods which was presented to 
teachers hy educational television. 

2 TO prepare an observation schedule ^ 

■ for^reporting the mathematics teaching behavior 

of intermediate grade teachers. 

To measure, before the lessons began, the teaching 
^h^Hf two sets Of teachers, one set who would 
take the course and the other who would not. 



12 



4. To moasurCj during vievlng period^ the 

room teaching behaviors of both sets of teachers. 

5. To determine whether changes in the 
behaviors of the viewing group were different 
■pr^rmi Chances in the non-viewing group of teachers 



Tte Development of an Observation Instrument. It is very difficult 
to obtain quantitative data about teacher behavior without using 
some device such as a rating form or a check list. Although such 
forms have been used in other teacher evaluation studies, the in- 
vestigator could not find an instrument which could be used to col- 



lect data about intermediate grade teachers when observers visited 
their mathematics classes. Early studies in the development of an 
observation schedule and record proved helpful, but these ideas were 
not usable until they were adapted to mathematics Instruction in the 
intermediate grades. Much of this adaptation was accomplished by 
Buck (196T) as he worked on a parallel doctoral study. 

Studies Related to Observat ion of Teach^; The early history of 
an observation schedule for studying teacher behavior goes back to 
the early 1900’s. Horn (191<^), Barr (1929) and Wrightstone (193*^) 



reported seme early studies in making observations of a teacher 
behavior in the classroom. These studies attempted to identify 
specific activities of teachers and to provide a check list for an 

observer to use in reporting their occurrence. 

Thomas (1929), Withall (19*^9). Cornell and others (1952) 
and Hughes (1959) attempted to classify such observations and 
establish identifying terminology for the interaction of teachers 
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and pupils in a learning situation. Withall called this inter- 
action the classroom climate, and to identify the behaviors more 
explicitly he developed a set of seven categories for teacher 
utterances. He then could classify observed behaviors according 

to the set of categories he had devised. 

Medley and Mitzel ( 1963 ) constructed an instrument vhich they 
called the OScAR (Observation Schedule and Record) . They used this 
instrument with teacher education graduates to provide quantitative 
data regarding the behavior of beginning teachers. The OScAR enu- 
merates representative items of behavior within certain categories. 
An observer simply checks any item on the list if that behavior 
occurs during an observation period. The observations were timed 
with five-minute intervals being spent in checking the items in each 
of several categories. This system mak^s it possible to take two 
important steps in the process of measuring clas Proem behavior: 

( 1 ) to secure a record of the sample of behaviors to be measured 
and (2) to quantify that record for further statistical study. 

The original OScAR represented an adaptation of ideas about 
gene al observations of classroom behaviors reported in earlier 
studies. The designers of the instrument, however, had not over- 
looked the possibility of preparing such a schedule for a par- 
ticular subject area. Schueler, Gold, and Mitzel ( 1962 ) raised 
the question of whether further development should be in the di- 
rection of a common schedule for all teaching or whether par- 
ticular subjects need detailed, individual sections. 
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other researchers have worked with the OScAR^ each to a- 
chieve a somewhat different purpose. Bowers and Soar (1961) used 
it to compare teachers in the area of human relationships. Wilk 
and Edson ( 19 ^) attempted to use it in a predictive study of 
teacher behavior. Schueler, Gold, and Mitzel (1962) used the OScAR 
to eval.uate kinescopes of student teacher behavior. 

Wri^t (1959) believed such an instrument could be used to 
me:asure the verbal teaching behaviors of teachers in secondary 
mathematics. Wrist's model classifies content process and at- 
titude by the level of the rigor and the pupil participation in the 
lesson. She found the instrument useful in discriminating between 

various groups and between styles of teaching. 

Buck, (1967) wished to use an observation schedule and record 
to study differences in intermediate grade teaching behaviors when 
years of experience and mathematics achievement test scores were 
used to classify teachers. Buck needed an instnanent especially 
designed to study the mathematics teaching activities of teachers, 
and he prepared a modification of the OScAR which he called the 
OScAR (EM) . He then selected fourteen pairs of intermediate grade 
teachers, seven pairs with fifteen or more years of experience and 
seven pairs who had tau^t five years or less. Each pair of 
teachers consisted of a teacher whose mathematics test scores were 
high and one whose scores were low. The pairs of teachers in Buck's 
study taught either in the same building or under the supervision 
of the same person. Buck made ten visits to each teacher, using 



15 



i/in 



i 



the OScAR (EM) to record his Impressions of their mathematics 



teaching hehavior. 

The observers ■ scores from the 280 visits supplied the date, 
vith vhich Buck tested and evaluated the elementary mathematics 
version of the OSoAR. After his visits to these fourteen pairs of 



teachers Buck concluded; 

1 . When their scores on mathematics achievement tests 
were hi^, teachers scored hi^er on the ei^t scales 
of the OSCAR (EM). Although Buck associated no 
qualitative evaluation of teacher hehavior vith hi^er 
scores on the tests, the items on most of the scales 
represented recommended teaching practices. 

2. When years of experience was a factor, the teachers 
scores on the OScAR (EM) were not significantly 
different. 

^ When years of experience and scores on achievement 

c«hSed, there vas no significant difference 

ir the OScAR (EM) scores. 

Since Buck's study was so closely related to this investigation, 
a detailed account of his work in developing the OScAR (EM) will he 



Included in this report (Appendix B) . 

Buck’s preliminary study of the OScAR (EM) made several im- 
portant contrihutlons to this investigation: (1) It tested the 

Instrument on a group of teachers who were judged to he a sample 
from the same population as those teachers taking part in this study 
Of television instruction, (2) It established scales which could he 
used to identify specific kinds of classroom teaching hehavior, (3) 
It provided evidence of the rellahillty of each scales W It dem 
onstrated that the scales were operating Independently, and (5) It 
provided evidence that the scales discriminated between teachers. 
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The limitations of any study vhich uses an observation schedule 
and record as a method of gathering data about teacher behavior have 
been taken into consideration. Boyd and DeVault (19^6) reviewed the 
literature on the observation and recording of behavior which has 
been published during the last six years. 

The reviewers pointed out some of the weaknesses of the descrip 

tive category type of instrument. 

"In strict terms descriptive categories are based solely 
on non- interpretative descriptions of observable overt 
behavior; the interpretative and inferential stages are 
made subspqusnt to the collection of the data. Evaluation 
datum categories require various degrees of interpretation 
at the time the data are collected; inferential analysis 
follows. It may be argued that interpretations and infer- 
ences made on overt data by someone not present at the time 
the behavior occurred may distort and/or omit aspects of the 
situation. . . .To require the observer to record all behaviors 
is a monumental task. Yet to have the observer do less, 
when employing purely descriptive categories, may result in 
serious misrepresentation of the observed situation. . . .The 
use of onlv overt behavior would remove, in addition, the 
concept of purposiveness of human behavior. .. .It is not 
always possible to classify a unit of behavior into a par- 
ticular category without considering the sequence of im- 
mediate acts or units . . . 

"A variable defined in terras of descriptive behaviors is 
based on the proposition that the descriptive behaviors are 
as complete as possible. This is an essential point that 
needs to be examined carefully. .. .If a behavior is to be 
observed it should not be so geieral that its meaning is 
lost because the observer could not record the conditions 
under which it occurred. 

"If the researcher wants to treat his observations in 
quantitative terms, he is faced with the problem of measure- 
ment.... It is not uncommon to find units defined in terms 
of both time and acts.... The advantage of time units is 
that a sequential analysis of total group interaction can 
be readily made.... If the unit is the act, then it is first 
necessary to define the act. 
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"The emphasis on ^^JJg”op‘in^olassroom learning 

emphasis 3^9f ’A teacher-s 

verl^l sL: T aso^bltTassLe that 

total behavior. It would seem^r ^^^^s with 

the burden of about the above assumption 

^o:irrrSred b^Sy^Urists and social psychologists. 

"The proper focus of 5*1^6 tte act tes been 

fr» Which the irobsSvational data 

an intriguing the person being observed 

collecting. •••It is ni^«prver ..; the fixed roles 

to have an influence on th the recording of very 

given the observer “®y/®°g^g-bserv^r is unable to interpret 
^hSrty^esT^rvior in__terms of the interpersonal 
dynamics of the situation. 

Boyd and IDeVault have raised many questions which concerned 
,e investigator as the study developed. The need for teacher 
ihavior studies in the elementary schools, however, is a pressing 
xe, and regardless of the limitations, which are indisputable, 
.searchers must continue to try to fine workable methods of ob- 
ervlng and reporting classroom strategies, 
ne selection of ^ for thj »• 

^ .<>.. 1 .. i. ~«r.l «* ‘~*- 

C»cli (>^h ™ •“ “•“* “ 

—r. ot .mo, .« «•«"» 
u.,ric«. »r, .r-M.0 U.oa^» 

.10. »« »• •“ " ““ 

ordered list were chosen. 

1. school districts in m^he“" 

study had previously conducted a series 01 

matics vorkshops were eliminated. 
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2 . Any district not vishing to take part in the study 
was excused and the next district on the selection 
list was invited. 

Three pairs of intermediate grade teachers were selected 
from each school district. In almost every case both teachers in 
each pair taught in the same building. When such an arrangement 
was not possible both teachers in the pair were supervised by the 
same person. All teachers taught fourth > fifth or sixth grade 
classes. One teacher from each pair was chosen by lot to take the 
El. Ed. 426 course in teaching mathematics. The other member of 
the pair agreed not to view any of the lesson presentations or 
study any of the course material during the experimental period. 
Those teachers who took the television course were designated ex- 
perimen"' teachers and those who did not take the course control 
teachers. 

Measuring Teacher Achievement . Before the television broad- 
casts began ^ all experimental and control teachers took two tests 
of mathematics achievement. The first test was the Test of Arlth - 
metic Principles by Stoneklng and Welch (1961). The authors re- 
ported a reliability coefficient of .92> but they gave no ex- 
planation of the formula they used to compute that statistic. 

(Page 25) The second test was A Test of Mathematics Vocabulary 
by Corle (1966). The reliability coefficient for this test (.89) 
was computed by the Kuder-Richardson formula #20 when the test was 
used with in-service teachers. 

Following the broadcasts, the experimental and the control 
teachers again took the two achievement tests. 
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Classroom Visits . Seven trained observers made 30 regular scheduled 
visits to each of the 32 teachers Involved In the study. The six- 
teen teachers In the experimental, or television viewing group, were 
visited seven times before the television course opened and 23 times 
after the broadcasts began. Visits to the control, or non- viewing 



teachers, corresponded exactly to those made to the experimental 
group. The observers followed essentially Buck's (196?) procedures. 

1. Times for visits were arranged to enable observers to 
complete their observation schedules. 

2. Teachers agreed not to give tests or study periods 
during the observation time. 



3. 



The actual observation time for each visit 
minutes, five minutes each for the four sections of 

the test. 



k. The observers coded the OScAR (EM), so teachers could 
not know which behaviors were being recorded. 



5 The seven observers rotated among the 32 teachers to 
minimize a "halo effect" from repeated observations. 

6. There was no feedback to teachers to indicate what 
kinds of behavior the observers were recording. 



7. The OScAR (BM) forms, when completed, were scored by 
the use of Buck's ei^t scales. 



The Television Course . El. Ed. 426 TeacMr^ Modern Mathemati cs 
was a graduate level course for elementary teachers (See page 2). 
It was patterned after a course carrying the seme name and number 
whleh is offered both on the University campus and in University 
continuing education centers throughout the commonwealth. The 
first two lessons consisted of a philosophical and methodological 
treatment of the changes in emphasis in elementary school mathe- 
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matics . The remlnlm broadcasts each featured some mathematical 
topic, and the instructor stressed new ways to present each topic. 
Concrete objects, cliarts, and a wide variety of teaching aids 
featured each broadcast. A special effort was made to keep these 
materials simple and easy to make. The instructor made no effort 
to indoctrinate teachers or to suggest that they follow his example. 
He assumed that if such devices enabled teachers to learn more 
readily, the teachers mi^t use them in their own classrooms. 

The instructor used his own textbook (Corle, 196k) and the 
lesson units followed the textbook material. The textbook re- 
commends considerable work with manipulative materials and offers 
many illustrations of simple devices for pupil and teacher use. 

Both the television broadcasts and the textbook stressed teacher- 
pupil interaction, problem solving through a discussion technique, 
and guided discovery as a desirable teaching procedure. A short 

summary of the course follows: 

1 . Teachers must learn to use a standard mathematical 
vocabulary which applies to a topic regardless of 
the grade level being tau^t. 

2 . Elementary school mathematics must be enlarged to 
Include ideas from related areas of mathematical 
knowledge. Geometry, algebra, sets, logic, and 
similar topics are all within the understanding of 
elementary children and use of these topics expand 
and enrich their mathematical experiences. 

3. Every computational operation which is taught in 
the elementary schools is understandable and every 
pupil must be given an opportunity to learn not 
only how the operation is performed but why it is 
done that way. 
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U. Qulded discovery is an effftive method of presenting 
matheiDS.tical ideas to children. 

The observation schedule and record used hy the observers in 
this study vas oriented to the above four principles of teaching 
modem mathematics to elementary school children. 

^ HatHi of ^ Data. The seven observers made 96O visits to the 
38 teachers taking part in the study. The experimental teachers 
vere visited ‘^80 times and the control teachers 480 times. There 
vere 112 threshold visits in each group and 368 visits made after 
the television lessons began. The observers computed the teacher 
behavior scores by counting the tallies for all of the items on each 
Of Buck's eight OSCAR (EM) scales. If a behavior occurred during a 
Visit, a tally vas entered for the appropriate item. The observer 
tallied the item only once during a visit, no matter hov often he 
saw it. Thus each visit to a teacher produced eight scale scares, 
and the classroom teaching behavior of each of the 32 subjects could 

be identified by 30 x 8, or 240 scale scores. 

Each Of the 32 teachers took a pre- and post-treatment ad- 
ministration Of tvo achievement tests (See page 19). Scores on each 
tests vere computed by citing the number of correct items. These 
tests measured (l) understanding of basic mathematical principles 
used in the elementary school and (2) familiarity vith the mathe- 
matical vocabulary appropriate to elementary school use. 

Treaim^nt of Data. Ibis study attempted to provide an 
ansver to the followins Problem. Will changes in the mathematics 
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teaching behavior of intermediate grade teachers, reported by ob- 
servers while the teachers are taking a 15-veek television course 
in teaching mathematics differ from that of other intermediate 

grade teachers not taking the course? 

The investigator sougpit to answer this question by using the 

following procedures: 

(1) He used analysis of covariance with teachers as a nested 
factor to study differences in means when the total scores on all 

of the scales were added together. 

(2) He then used analysis of covariance with teachers as a 
nested factor to study differences in the means of each scale, 
computed separately. 

III. RESULTS 

Statis tical Analysis of Observation Data . Table 1 shows the 
data which was developed by submitting the total scores on the 
OScAR (EM) to analysis of covariance using teachers as a nested 



factor. 
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Table 1 shows that there were no significant differences 
either among the teachers or between the groups. This fact in- 
dicates that the observed behaviors reported from the visits were 
much alike, no matter what teacher was Involved. Groups had been 
defined according to the treatment they received, television or no 
television. There was no significant difference between the groups 
when total scores on the eight scales were analyzed. 

Table 1, however, did show a significant difference within 
the scales. Since each of the scales was developed as an independ- 
ent measure, a hl^ P ratio (40.66) between the mean scores was 
expected. Although the difference between groups by scales was not 
significant when total scores were considered, there was a possi- 
bility that differences between groups actually had occurred if 
each of the scales were considered independently. The P ratio of 
1.24, between the mean scores when groups were combined with scales, 
was not significant. If, however, offsetting differences in scores 
occurred when scales were used to measure teacher behaviors, there 
might be differences between the means of one or more of the scales. 
The mean scores on each of the eight scales were then examined 
through analysis of covariance using teachers as a nested factor. 
This was done to find out whether scale differences between groups 
were significant. Table 2 shows these data. 



25 



o 






s 

a 

tn 

la 

§ 

0 

CO 

1 

|8 



0 

1 

«> 

0 

s 

•H 

1 

O 



o 

•H 

•P 

& 






•o 

^ s 

(0 (d 
T? JS 

^3 

&U 

(0 y-N 

£ « >> 

52 ! EH*-^ 

'^•p fl 
H o cd 
0 0 4 ) 

h 

8S^ 

I fi 

01 

£ 



£ 






*a 

■p fl 

a a 

0 S 

‘5 



•p 

H CO^ 

|g^ 



I 

& 



ii S 
££ 



£ 


H 


H 


H 


H 


A 


H 


fH 


LfN 


V 


V 


V 


V 


CU 

• 


V 


V 


CU 










if\ 






VO 

CV) 

• 


OV 

-4 

• 


4 

CO 

• 


■a 

« 


o 

CVi 

• 


ir\ 

O 

* 

f 


ITN 

OO 

• 


c^ 

LA 

• 


ITS 


CO 

oo 


irv 

4 


4 

4 


v 3 


t- 

• 


• 


o 

00 

• 


VD 

o 


»i. 


v 6 

H 


VO 

iH 


lA 

4 


0 ^ 

VO 


VO 


51 


H 


H 


rH 










CO 

vx) 


o 

l/V 


VO 

irv 


CO 

VO 


lA 


o 

o 

• 


8 

• 


00 

00 

• 


vd 

o 


• 

H 

cn 


lA 

H 


vd 

H 


lA 

4 


OS 

so 


v 3 






H 


rH 










m 

t-- 


H 

00 


8 


8 




CO 

"H 

• 


o 

LA 

• 


4 

OV 

• 


vd 

a 


• 

ITv 

CO 




§ 




s 


4 

lA 


00 


VO 

<M 

• 


ON 

4 * 

• 


4 

CO 

• 


a 

• 


O 

CVi 

• 


LA 

O 

• 

1 


lA 

CO 

• 


c^ 

lA 

• 


1 

00 


H 

ov 


S' 


00 

CO 


# 


MD 

LTV 

• 


o 

00 

• 


4 

H 

• 


• 

-si* 

S!| 


• 

t- 

os 


lA 

d 


H 

51 


CO 

1 /N 


<y 

LA 




LA 

H 


VO 

00 


IfV 

t- 


CO 


a 


H 

CO 


H 

CO 

• 


• 


• 


• 

- 4 - 

a 


00 

(M 


H 


H 

5) 


OO 

Lf\ 


OO 

ir\ 


$ 


VO 

H 



taUl? 

' S 
£ 

s 
s 

CO 



£ 



VO 

9 



8 

Gl 



8 

vp 



GO LT\ 

CO CVJ 



-d- 

Ov 



CO 

VO 



-g 3 ^8 Sn 9 



CO 



ITS VO 



CO 



O 

O 

s 

•H 

o 

«p 

o 



4 ? 



ir\ 

O 



P 

«d 

“S 

0 ) 

o 

•H 

«P 

•H 

g) 

•H 

00 

t- 

H 

O 

•H 

Em 

♦ 



26 



*>,=+ the adlusted mean of experimental 
Table 2 shovs that the aaju»bc 

teachers vas somevhat higher than that of control teachers. The 
.tfference. however, was not significant. Scale 1 , ^ Si* 

.ecting Strategies. ^ ^ 

.P/>« «n scales appear itt 
items: (The items for all scales vv 

1. pupil agrees vith teacher. 

2. pupil offers hypothesis. 

3'. Teacher poses leading or structuring .questions, 
h. Teacher rephrases or restructures pupil contribution. 

5. Teacher requests pupil to repeat contribution. 

6. Teacher applies logic to mathematical ideas. 

7. Teacher introduces concept through problem. 

8. Teacher uses illustration. 

9. Teacher uses social application. 

items on Scale 1 include teaching strategies which, when 

„aed in a mathematics class, would produce a desirable hind of 

lesson environment for elementary school children. 

+ Riffnif leant, the observers apparently saw e 
difference was not signi - 

e-iniT qcale 1 strategies more often 

teachers in the .-lewlng group using seal 

than the non-vie^ns teachers. Xf such were the case, the moti. 
tion to use these strategies mi^t have come from the telecasts. 

scale 2, Pjffia-Teacher Interaction, consisted of the follow ng 

four items: 

1. pupil gives verbal assistance to another pupil. 

2. pupil expresses disagreement with teacher. 
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3 9 Teacher allows pupil choice of solution. 

4. Teacher interrelates mathematical ideas. 



There was no significant 



differen@e between the mean score 



of 



teachers in the experimental group and that of teachers in the 

control group when measured hy Scale 2 . 

scale 3, Teacher Yocahulary Emphasis, contained seven items, as 

follows : 



1. Decimal 

2 . Number 

3 . Numeral 

4. Zero 

5. Divide 



6. Regrouping 



7. Teacher uses Blackboard 

The mean score of the experimental teachers vas not significantly 

different from that of control teachers on Scale 3- 

The six items on Scale 4, Classroom piBcuss , l on Strateg ies, are 

shown below: 



1. Pupil offers possible solution. 

2. Pupil volunteers pertinent information. 

3. Teacher asks pupil to Illustrate ansver. 

4. Teacher locates key contributor and calls on him 

5. Teacher waits for pupil to formulate answer. 

6. Teacher uses mathematical rule or principle. 
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There was no significant difference between mean scores of experi- 
mental and control teachers on Scale k of the OScAR (EM). 



The six items on Scale Teacher Motivating Behavior^ are 



The mean score of teachers in the experimental group was not 
significantly different from that of the control group on Scale 5 



of the OScAR (EM). 

Scale 6 contained five items as follows: 

1. Pupils compute on chalkboard. 

2. Teacher asks pupil how he solved problem. 

3. Teacher refers statement or question to another pupil. 

4. Teacher makes reproving remark c 

5 . Teacher accepts solution without comment . 



The ^ 1 °°" score for the control teachers on Scale 6 of the OScAR (EM) 
was significantly higher than that of the experimental teachers . 

The teacher activities listed under Scale 6 could well he classified 
as undesirable methodology, much as Scale 1 seemed to reflect a 
more desirable approach. For example j (1) having the pupil put the 
example on the blackboard, ( 2 ) asking for an explanation of his 



Shown below: 



1. Sum 

2. Teacher uses environmental object. 

3 . Teacher encourages alternate solution. 

4. Teacher adds enrichment for pupils. 

5 . Teacher develops rule or formula for procedure. 

6 . Teacher questions correct answer. 
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„„„ ««». »-« .u »' 

Instructional practices . 

«« .«* «. .« i««-* “ “ • '^“•™ • “ 

4 .v,o o«iv aiffnificant difference between 
of teachers. However, the only slgnliic 

groups appeared on Scale 6. Since the inean score of the 
group exceeded that of the experimental group, the observers 
control teachers using these items more often than they saw ex- 
perlmental teachers using them, .be television course could 
responsible for Increasing the frequency of a. practice amo^ con- 
trol teachers, but these lessons ml^t have reduced somewhat e 
Of such procedures by the experimental teachers, -me tele - 
Sion lessons advocated a pupil-centered, discovery type of lesson, 
.tinting shius llhe .hose Indicated In Scale 1. viewing 

the broadcasts and completing the written lessons, some of 
heachers possibly substituted other practices for some of those 

listed in Scale 6. 

T p«f*f»rence to Fundamental Onerati _> 
scale 7, teacher Vocsbulasr 

vas ccmiposed of four items. 

1. Add 

2 . Multiply 

3. Remainder 

k. Subtract 

difference in the mean score of experimental teachers 
There was ffio difference xu 

/«mi\ that of the control teachers, 

on scale 7 of the OScAR W from that 
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Scale 8, Information Seeking by Puplla, contained only two 
Ixems: 

1. Pupil requests more information. 

2. Pupil seeks teacher's help. 

There was no difference in the mean scores of experimental and 
control teachers on Scale 8 of the OScAR (EM). 

The mean scores of experimental and control teachers on Scales 
2, 3, 4, 5> 7 and 8 did not differ significantly from each other. 

Some difference, althou^ it was not significant, occurred in 
Scale 1. Observers reported a hi^er frequency of desirable be- 
haviors among the experimental, or television viewing teachers. On 
Scale 6, the control, or non-viewing teachers made significantly 
higher scores than the viewing teachers. The items in Scale 6 re- 
presented doubtful or undesirable practices. Perhaps the televi- 
sion viewing teachers found some ideas either in the telecasts, the 
textbook, or the study guide which led them to make these corrections 
in teaching strategy. 

Teacher Achievement in Mathematics ; The achievement tests given to 
the teachers in both treatment groups were discussed on Page 19* 

All teachers in both groups took the tests before the threshold 
visits began and again when the television viewing period ended. 

Table l6 (Appendix C) shows the teachers' scores on the tests. 

Table 3 shows the data on the Test of Arithmetic Principles 
for the experimental and the control teachers on the pre- and post- 
test. 
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TalJle 3 

Pre- and Poat-teat Reaults of Experimental and Control Teaehera 
on the !Test of Arithmetic Prineiplea 



Teachers 


Pre Test 
Mean 


post Test 
Mean 


Adjusted 

Mean 


Mean 

Square 


P- 


Experimental (TV) 
Control (No TV) 


54 .CHD 

50.00 


3T-T5 

50.9*^ 


56.41 

52.28 


131-76 

30.11 




♦Significant at the 


.05 level of confidence 







Otoe experimental teachers made significantly hi^er gains on 
the Test of Arittimetic Principles . Teachers who viewed the hroad- 
casts and studied the written lessons improved their Imowledge of 
arithmetic principles during the viewing period. 

Table ii- shows the pre- and post-test data on the Test of 

Mathematics Vocabulary. 



Table ^ ,1. 

Pre- and Post-test Results of Experimental and Control Teachers 
on the Test of Mathematics Vocabulary 



Teachers 



Pre Test Post Test Adjusted Mean F- 
Mean Mean Mean Square Ratio 



Experimental (TV) 
Control (No TV) 



35-13 ^T-19 

29.44 34.31 



45.04 

36.46 



^H^signif leant at the .01 level of confidence 



530.72 

33.58 15.80** 



The experimental teachers also made significantly higher gains 
on the Test of Mathematics Vocabulary. The teachers who viewed the 
broadcasts and completed the lesson assignments appeared to improve 
in their ability to understand mathematical vocabulary. 

The foregoing data indicates that the teachers who studied the 
course by television achieved a hl^er level of mathematics under** 
standing than those who did not. All of the experimental teachers 
submitted their lessons promptly, took the midterm and final exami- 
nation at the proper time and often sought special help with their 
course work. The telecasts of regular lessons were repeated, and 
teachers often reported that they had watched both showings. The 
viewing teachers in a school district sometimes organized a kind 
of seminar to watch the broadcasts . After each showing they dis- 
cussed the ideas presented and completed their assignment sheets 
together. A combination of telecasts, readings, lesson sheets, and 
discussion apparently raised the level of mathematics achievement 
for these teachers. 

Summary of ^ Data ; The purpose of this study was to determine 
whettier changes made in intermediate grade teachers' mathematics 
teaching behaviors while they were taking a television course in 
mathematilcs teaching methods differed from changes made by other 
intermediate teachers not taking thtj course. The data appears to 
support the following statements: 

1, There were no significant differences among the teachers 
when total scores on the eight scales were considered. 
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2. Using total scores on the ei^t scales, the difference 
between groups (television and no television) was not significant. 

3. Differences between the scales were significant when total 

scores on all scales were analyzed. 

Iv. Differences between scales within groups were not slgnlf- 

ioant when the total scores on all scales were analyzed. 

When each scale was analyzed separately, the following 



statements could he supported; 

5. on Scales 2, 3, 5 , T, and 8 there was no significant 

difference between groups. 

6. on scale 1, although the difference was not significant, 
there was some indication of more desirable teaching behavior among 



the television viewing group of teachers. 

T. on scale 6, there was a significant difference in mean 

scores of the two groups. The tele’/islr..^ viewing teachers appeared 

to make desirable changes in their teaching strategies more fre- 

quently than the control teachers. 

rowarlance analysis of achievement test scores showed the 



following changes. 

8. The experimental teachers (television viewing) made signif- 
icantly greater gains on the Test ^ Principles. 

9. The experimental teachers made significantly greater gains 



on the Test of Mathematics Vocabulary. 



IV. DISCUSSION 



Dlatrltoutlon of Teaching Time During Visits. An unforeseen 
element of teacher behavior became apparent as the observers com- 
pleted the early rounds of visits, and that element vas the low 
percentage of time spent on developmental lessons. The OScAR (IM) 
was designed to measure teacher behavior in a verbally Interacting 
classroom atmosphere. VIhen it became apparent to the observers 
that the teachers were spending much less than the recommended 
portion of the class period In developmental teaching, the ob- 
servers decided to keep a record of the time spent In various kinds 
of class activity. Recent studies by Shipp and Deer, (i960) Zahn, 
(1966) and Shuster and Plgge, (1965) agreed the; teachers should 
spend at least 505^ of the class time in teacher-pupil verbal inter- 
action, developing new ideas, and applying them. Buck (1967) re- 
ported that about 12 percent of the teachers- time was devoted to 
preparing the class for its lesson, 33 percent to developmental 
teaching, 36 percent to review and drill, and 17 percent to cor 
recting assignments. Milgrsm's (1967) estimates were as follows: 
going over previous assignment, 25 percent; oral or written drill, 

51 percent; Introduction of new concepts or developmental activities 
23 percent; unrelated activities, 1 percent. Both observers re- 
ported that there appeared to be no difference between treatment 
groups in the percentage of time spent in the various kinds of 

teaching activity. 



A characteristic lesson, as reported unofficially hy these 
observers, consisted of an assignment from the book, a brief ex- 
planation by the teacher of how to solve the examples and then a 
supervised work period. The next class began by assigning various 
pupils an example to put on the blackboard, a recitation by the 
pupil of how he solved the example, and corrections made by the 
teacher. Another assignment, very much like the previous one, 
generally followed the correction of homework papers. 

■Unce the purpose of the study was to determine any changes 
which might be attributable to television instruction, there could 
be no feedback from the observers to the teachers. Teachers were 
unaware of the nature of the behaviors being observed, and there- 
fore found little motivation to change the daily routines. 

Obviously, the greater emphasis on drill activities and cor- 
recting assignments reduced the number of item responses to the 
OSCAR (EM) both for the experimental and the control teachers. 

The experiment was conducted in a geographical area which has 
been slow to accept the teaching behaviors commonly identified with 



the so-called modern approach to elementary school mathematics, 
unofficial reports from the observers indicated that many of the 
teachers felt insecure in their knowledge of the modem treatment 
of mathematics and somewhat uncomfortable in being visited by 



"experts" . It is possible that these teachers utilized teaching 
procedures which would expose them as Uttle as possible to any 
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kind of critical evaluation. Perhaps on days they were not visited 
they made greater use of pupil- centered methods. 

Mathematics Achievement ; The teachers who took the television course 
gained significantly more mathematical knowledge than those teachers 
who did not take any course during the experimental period. The 
test scores of the experimental teachers were higher both on the 
test of arithmetic principles and on the test of mathematics vocab- 
ulary. These gains show that the teachers took their work seriously 
and that learning did take place. The generalization can be sup- 
ported by the quality of work submitted to the correspondence center. 
The scores on the midterm and the final examination also indicated 
that creditable course work had been done. Group viewing by partic- 
ipating teachers and the study sessions which followed brought a 
new dimension into the El. Ed. 426 TV, that of small-group inter- 
action in learning about mathematics and how to teach it. 

Classroom Teaching Behavior ; Six of the eig^t OScAR (EM) scales 
failed to show any noticeable difference between the treatment 
groups. Scale 6 showed the control group made a significantly 
higher mean score than the experimental group. Scale 1 showed that 
the mean scores of experimental teachers were higher, but not sig- 
nificantly so. Scale 1 contained items which might be observed 
when the teacher was using a desirable teaching sequence. Scale 6 
was made up of items which, when used sequentially, would seem to 
be undesirable. Since the experimental teachers used the items in 
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scale 1 more often and the control teacher need thoee on Scale 6 
more often. It le poesihle that acme effect of the television in- 
struction had begun to appear vl-mn the experimental group. 

There may he two explanations for the similarity of scores on 
the other tvo scales. ( 1 ) The scales ml^t not have been sensitive 
enough to detect simple cnanges in teaching behavior. Buck’s (1967) 
study established the stability of the scales, their Independence 
from each other, and their reliability as measuring Instruments. 

He worked only with teachers who were not involved in any kind of 
instructional treatment and prepared the scales from scores made by 
these teachers. Items which might have shown more creative teaching 
behaviors possibly were not included in the scales. ( 2 ) The ex- 
perimental teachers perhaps did not make substantial changes in 
their teaching strategies. The unofficial report of the observers 
(See page 35) indicated that the percentage of teaching time spent 
in teacher-pupil interaction was low, both for experimental and con- 
trol teachers. There was no feedback from the observers, and 
teachers could not know what kinds of behavior were expected of them. 
A fifteen-week period is a rather short time to expect much change 
in teaching strategies. It is not easy for teachers to abandon 
habits Of long standing in such a short period of time. Wlthall 
(1956) reported a study in which he had used deliberate feedback 
techniques, even to the point of getting teachers to agree to change 
their behavior. later observations, however, did not show that such 

changes had occurred. 
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conclusions : Certain teaching behaviors employed hy Intermediate 

grade teachers may undergo changes during the period of time when 
these teachers are taking a television course in teaching mathe- 
matics. Those changes most likely to occur consist of sequences of 
teaching strategies used hy the teacher in conducting the class. 

Other hehaviors investigated either did not change or the instrument 
used in the observations was not sensitive enough to measure the 

differences . 

The teachers taking part in the television course made signif- 
icantly greater gains on mathematics achievement test scores than 
those not taking the course. This fact is evidence that in-service 
teachers can and will work to Improve -ttieir own knowledge of mathe- 

matlcs . 

The observation period might have been too short for the ob- 
servers to detect changes in teachers' behaviors. According to 
unofficial observation reports, both experimental and control teachers 
used a disproportionate part of the class time on non-interaction 
learning situations. Since the scales of the OScAR (EM) were designed 
to measure teacher-pupil interaction, the number of items which the 
observers might have checked was undoubtedly affected by the time 
spent in verbal interaction. The inertia of teachers, the tendency 
to follow day-to-day routines, must se recognized as a limitation of 
this study. It is possible that other changes did take place; some 
of them occurred after the visits had ended. 



39 



The Bjty’s between the threshold visits and the viewing period 
visits were low (Table 2) when scores on the eight scales were 
correlated. A low correlation between the pre- and post- adminis- 
trations of an instrument is an indication of two possible situations: 
(1) The instrument is not sensitive enou^ {^oes not contain enou^ 
items) to measure all of the behaviors which occur. (2) There is 
little or no relationship between the measurable items which did 
occur on the two sets of visits. Of the two situations, the former 
was more likely to occur, but because different mathematical topics 
were being taught by the teachers under observation, as lessons fol- 
lowed each other, the second situation might also have been true. 
implications ; Boyd and DeVault (1966) expressed a note of caution 
about the use of observation techniques for the evaluation of 
teacher behavior: (D There is a danger of Inferential analysis of 

Observable overt behavior. (2) Consideration of only overt behavior 
removes the element of purposiveness. (3) Once behavior is identi- 
fied, the researcher faces the problem of measurement. (‘^) Observed 
behaviors may not represent the total behavior in the classroom. 

The four limitations outlined by Boyd and DeVault represented most 
of the concerns felt by the investigator about this study. The 
decision to conduct this research, however, was supported by three 
beliefs: (l) The real measure of a teacher's effectiveness can be 

found only throu^ systematic observation of that teacher's work 
in the classroom. (2) Observations of teachers at work are in- 

Instrument for re cording > analyzing, and 



effective without some 



reporting their hehaviore. ( 3 ) Repeated investigations, each of 
vhich huilds upon another one, provide the best method of refining 
and perfecting instruments for studying a teacher's behavior. 

Educational television stations which serve remote areas should 
explore the possibility of braodcasting mathematics methods courses 
to teachers. Teachers taking the course appear to improve their 
knowledge of mathematics and possibly to change some of their teaching 

behaviors . 
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SUMMARY 



The pvirpoee of this Investigation was to determine whether 
changes in the mathematics teaching l.ehavlor of intermediate grade 
teachers reported while they were taking a 15 -week course in teach- 
ing mathematics differed from the changes made hy other teachers 

Who were not taking the course. 

WPSX-T7, the educational television station of the Pennsylvania 
State university broadcast an in-service course for teachers of 
elementary grades, El. Ed. Us6, Teac^ Modern Mathematl ^ during 
the spring semester, 1966. The course was offered for graduate 
and undergraduate credit and was administered by the Correspondence 
Department of the University. The investigator was the instructor 

of the coui'se. 

Sixteen pairs of teachers from six school districts in the 
broadcast area took part in the study. The teachers in each pair 
were teaching in the same attendance unit. One teacher from each 
pair was chosen by lot to take the course; the other teacher agreed 
to take no part in any of the activities related to the course. 



The design of the study was as follows. 

1. TO measure the mathematics achievement of the teachers in 
the Sixteen pairs before the course began and after it was completed 

2 . TO make threshold visits to each of the 32 mathematics 
Classrooms tau^t by these teachers to observe their teaching be- 
haviors prior to the period of Instruction. 



3. To continue the visits during the viewing period, both 
to the classroom of teachers taking the course (experimental) and 
those not taking it (control). 

4. To quantify the behaviors observed during these visits 
and study changes in teacher strategies which occurred during the 
television viewing period. 

As a part of his doctoral research, Buck (196?) prepared an 
Observation Schedule and Record for Elementary Mathematics which 
he called the OScAR (EM). This instrument was a modification of 
the OScAR, which had been developed by Medley and Mitzel ( 1963 ) to 
study the classroom behaviors of teachers. Buck divided this in- 
strument into eight scales, each designed to measure a different 
classification of teacher behavior. 

Seven trained observers made 30 visits to each of the 32 
teachers in the study. Seven of the visits were threshold visits 
and 23 of them were made after the lessons began. The observers 
used 20 minutes during each visit to record on the OScAR (EM) the 
mathematics teaching behaviors of the teacher being visited. The 
investigator then used the ei^t scales of the instnament to classify 
the information secured during the classroom visits. 

Conclusions ; Bata developed throu^ analysis of the observation 
reports indicated that certain changes in teaching strategies prob- 
ably occurred among the television viewing teachers. The changes 
seemed to appear most often in the teaching sequences, or the 
strategies used in conducting the classes. Two of the scales which 
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measured these behaviors showed observable differences between the 
groups. No observable differences appeared on any of the other six 

scales . 

The experlaental teachers sKjniflcantly outgalned the control 

teachers on two tests of mathematics achievement, a Test Arlto- 

metlc Principles and a Test of Mathematics VocabulB^. 

A fifteen-week period was probably too short to gather 

complete information about behavior changes. This was a learning 
period for teachers, and by the time It ended, there was too little 
time for teachers to take fuU advantage of what they had learned. 

There was no feedback, and teachers could only surmise the 
teaching behaviors the observers might have been seeking. Study 
of methods together with feedback from supervisors might have been 



more productive of change. 
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Items of the OScAR (EM) 



Appendix A 
OScAR (EM) 
Pert 1 







1. 


VCBLRY, OBJCTV MTRLS 




• • 


A. NMRTN 


1. 


B. COMPTN 


1. 


C. GMmV 




be 




edd 




ere 




crdnl 




ednd 




cnernt 




cnts.ntrl.nmbr 




errv 




In 




dcml 




esctv prntv 




In semnt 




dfft 




bny oprtn 




pnt 




expnd ntetn 




cmn dnmtr 









expnt.exnntl ntetn 




cmttv prpty 




smpl clsd erv 




inter 




cmpstn 




smpl clsd srfc 




nnbr 




dfrnce 




D. STS 




nm f nmbr 




detrbtv prpty 




dsint 




netv mnbr 




dvde 




elmnt 




nmrl 


1 


enumrt 




empt, nil 




ordr 




eatn 




eavlnt 




ordrd nr 




eqvlnt frctn 




idntl 




ordnl 




fctrs 




intsetn 




pic 




ertr thn 




St 




pic hldr 




idnty elmnt 




sbst 




PS tv nmbr 




Is thn 




unn 




pwr 




msrmnt 




ootnt 




prpty 




mltple 




rto 1 




rtnl nmbr 




mltply. mltplctn 




rmndr 




rl nmbr 




mr thn 




rcprl. invrs 




sen nmbr 




nmbr.mthmtcl tntn 




repne, rnmne 




verbl 




oprtn 




ebtrt 




whl mnbr 




pertn 




Qum 




er 




prm.prm nmbr 




unknown 








prdct 


X + y^i^ e: x - y(^ e 
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I. A. Numeration 

Base 

cardinal 

counting number, 
natural number 
decimal 
digit 

expanded notation 
exponent or 
exponential notation 
Integer 
number 

name for number 
negative number 
numeral 
order 

ordered pair 

ordinal 

place 

placeholder 
positive number 
power 
property 
real number 
rational number 
sign number 
variable 
whole number 
zero 



Computation 

add 

addend 

array 

associative property 
binary operation 
common den ^uiinator 
commutative property 
compensation 
difference 

distributive property 

divide 

enumerate 

equation 

equivalent fraction 

factors 

greater than 

identity element 

less than 

measurement 

multiple 

multiply or multiplication 
more than 

number or mathematical 
sentence 
operation 
partition 

prime or prime number 
product 



I. VOCABULARY AND OBJECTIVE MATERIALS 

I. B. 



I. C, Geometry 
arc 

congruent 

line 

line segment 

point 

ray 

simple closed surve 
simple closed surface 



I. D. Sets 

disjoint 

element 

empty or null 

equivalent 

identical 

intersection 

set 

subset 

union 

quotient 

ratio 

remainder 

reciprocal or Inverse 
regrouping, renaming 
subtract 
sum 

unknowir 

X + y z; X - y z 



k9 



m 

m 

d 



.c I 






OScAR (EM) 

Part I 
'^''ontinued) 



VCBLRY, OBJCTV MlELS (continued) 



L. E. I'lNPLTV DVCS 


1. 


F. DMNSTRTV DVCS 


Abcs.cntdt frift 




bltn brd 


clcltr 




calndr 


chrnratr 




chldrn 


clclc 




ehlV.brd-cmpts 


comps 




chlkbrd-ilstrts 


cntnjs dvc 




chrt 


csnre rds 




envrnmntl ob^ 


dmns 




flm 


flnl brd 




flmstrp 


fish crds 




grph 


frctnl prts 




mps 


OTutrc fccrs 




mtrc chrt 


mentc brd 




mobl 


mcrmtr 




nmbr In — 


plv or rl mnv 




obrhd oritr 


prtctr 




pstr 


rlr 




thrmtr 


scl 




wthr instrmnt 


sldrl 






vrdstck 


















TCHR 




Total 1 


OBSVR 




Total 11 


D£lt6 




Total ill 


Time 




Total IV 


Place 




Grand Total 



50 











E, Manipulative Devices 



I, F. Demonstrative Devices 



Abacus or counting frame 

calculator 

chronometer 

clock 

compass 

counting device 

cuisenaire rods 

dominoes 

flannel board 

flash carde 

fractional parts 

geometric figures 

magnetic board 

micrometer 

play or real money 

protractor 

ruler 

scales 

sliderule 

yardstick 



bulletin board 

calendar 

children 

chalkboard computes 
chalkboard illustrates 
chart 

environmental object 
film 

filmstrip 

graph 

maps 

metric chart 

mobile 

number line 

overhead projector 

poster 

thermometer 

weather instrument 



OScAR (EM) 
Part II 





II. Ppl Intatd 


INTRCTN 


ITT 


a. Pnl-Pol Intrctn 1 


II. 


H. Ppl-Tchr Intrctn 


1 Jb • 






HI agrs w tchr 


1 


G2 dsagrs w clsmte 1 




H2 ascts nw ski w id anthr 
cntxt 




G3 dfnds clsmte pnt vw 1 




H3 exprss dsgrmnt w tchr 




G4 dfnds own ont vw J 




H4 ignrs tchr qustn 




PTnT>f"p^< on cVk Ikbifci J 




H5 ofrs hvpths 








H6 ofrs posbl sltn 




G7 evs vrbl as tnc anthr ppjJ 




H7 rqsts mr infrmtn 




G8 rqsts anthr ppl rpt stmnt 




H8 rqusts tchr rpt stmnt 




G9 verbly exprss insght, 




H9 sks tchr hip 




GIO volntrly ilstrts any mdia 




HlO volntr invstgt unslvd 
nrblm 








Hll volntr Rt mr infrmtn 








H12 volntr reltd, prtnt 
infrmtn 
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II. PUPIL INITIATED INTERACTION 



II. G. Pupil-Pupil Interaction 

G1 Agrees with classmate 
G2 Disagrees with another pupil 
G3 Defends classmate's point of view 
G4 Defends own point of view 
G5 Demonstrates on chalkboard 
G6 Computes on chalkboard 

G7 Gives verbal assistance to another pupil 
G8 Requests another pupil to repeat statement 
G9 Verbally expresses insight or understanding 
GIO Voluntarily illustrates by any media 



II. H. Pupil-Teacher Interaction 
HI Agrees with teacher 

H2 Associates new skill with idea in another context 

H3 Expresses disagreement with teacher 

H4 Ignores teacher's question 

H5 Offers hypothesis 

H6 Offers possible solution 

H7 Requests more information 

H8 Requests teacher to repeat statement 

H9 Seeks teacher's help 

HIO Volunteers to investigate an unsolved problem 

Hll Volunteers to get more information 

H12 Volunteers related or pertinent information 
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OScAR (EM) 
Part III 







TCKR-INTATD INTRCTN P 


[II, 


K TCKR RCP’IVTY 






IT TnHR-PPL INTRCTN L 




K1 acots soltn w/o emnt 






Ti aks ool ilstrt answr 1 




K2 aeots stmnt w/o emnt 




T9 aka ool ho h slvd prblml 




K3 aeptnt n-vrbl aknldgmnt 






J3 discsn mdrtr I 




K4 alws anthr ppl evlte 
ans. 






J4 pos Idng, strctg qustn, 
stmnt 1 




K5 alws any ppl rstte 
entrb 




J5 lets ky cntrbtrj els on 
hm 




K6 alws ppl dede ehee sltn 




J6 inks rorvng rmrk 1 




K7 antpts sgnfent dvlpmnt 




T7 rrffoza ar ool inadqcy 




K8 dmnstrts afetn fr ppl 




J8 rfrs ppl qustn to anthr 
ppl 




K9 energs altrnt sltn 




J9 rphrss, rstretrs ppl 
cntrbtn 




KIO ignrs ppl stmnt, qustn 




JIO rqst ppl rpt stmnt, 

entrbtn 




Kll Icks smpthy w ppl fire 




.Til rqst ppl evlte entrbtn 




K12 uses ostv renfremnt 




J12 uses sresm 




K13 wrts fr ppl frmlt thnk 
ans 
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III. 



TEACHER INITIATED INTERACTION 



III. J. Teacher-Pupil Interaction 



J1 Asks pupil to illustrate answer 

J2 Asks pupil how he solved problem 

J3 Discussion moderator 

J4 Poses leading or structuring question 

J5 Locates key contributor and calls on him 

J6 Recognizes area of pupil inadequacy 

J7 Refers pupil question to another pupil 

J8 Refers pupil statement to another pupil 

J9 Rephrases or restructures pupil contribution 

JlO Requests pupil to repeat statement or contribution 

Jll Requests pupil to evaluate contribution 

J12 Uses sarcasm 



•V 






III. K. Teacher Receptivity 



K1 Accepts solution without comment 
K2 Accepts statement without comment 
K3 Acceptant non-verbal acknowledgment 
K4 Allows another pupil to evaluate answer 
K5 Allows any pupil to restate contribution 
K6 Allows pupil to decide choice of solution 
K7 Anticipates significant development 
K8 Demonstrates affection for pupil 
K9 Encourages alternate solution 
KIO Ignores pupil statement or question 
Kll Lacks sympathy with pupil failure 
K12 Uses positive reinforcement 

K13 Waits for pupil to formulate and think answer 
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OScAR (EM) 
Part IV 



IV. 


L. TCHR DXTRTY W MTHMTCL IDS 




Ll ads enrchmnt for ppl 




L2 alws els qustn, stmnt prblm bk 




L3 An Is lee mthmtcl ids 




L4 dvlps frmla, rle fr prede 




L5 intrls mthmtcl ids 




L6 intrdcs cncpt thru prblm 




L7 intrdcs hstrcl infrmtn 




L8 mtvts thru pzl, odty, et^ — 




L9 qustns cret answr 




LIO rfrs avalble enrchmnt 




Lll uses ilstrtn 




L12 uses mthmtcl rl or prncple 




L13 uses opn end prblm 




L14 uses prblm w varbles 




L15 uses ppl ping 




L16 uses scl aplctn 








Type of Lesson — . 




Introductory 




Ongoing, Devel. — . 




Drill 




Review 




Correcting Assignments 




Culminating — 
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IV. 



TEACHER DEXTERITY WITH MATHEMATICAL IDEAS 



LI Adds enrichment for pupil 

L2 Allows class to question statement, problem in book 

L3 Applies logic to mathematical ideas 

L4 Develops formula or rule for procedure 

L5 Interrelates mathematical ideas 

L6 Introduces concept through problem 

L7 Introduces historical information 

L8 Motivates through puzzle, oddity, etc, 

L9 Questions correct answer 

LIO Refers to available enrichment 

Lll Uses. illustration 

L12 Uses mathematical rule or principle 

LI 3 Uses open end problem 

L14 Uses problem with variable 

L15 Uses pupil planning 

L16 Uses social application 
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Buck (1967) served as research assistant to the project 
director of this study. As a part of his own doctoral research, he 
helped select ite»s for the observation schedule and record tested 

the instruBent, trained the observers, and supervised the teaB of 

u p 11 of the classroom visits for both this ihveSw- 

persons who made all of the cj.aoyr« 

A report of the development of the 

gation and hls own. A detailed reporx u 

OScAR (EM) is included here. 

First, Buck Identified l80 items of behavior which appeared 
to be related to elementary school mathematics teaching, ,See 
Appendix A) He separated t^ese items into six categories as fol- 
lows. For ease in scoring he combined -vocabulary" and "objective 
teaching aids" into one section and "teacher initiated interaction" 
and "teacher receptivity to pupils' ideas" into another section, 
organization of the items on the check list is shown below: 

70 - Vocabulary 

Section 1 38 - Objective teact.ing aids 

section 2 22 - Pupil initiated interaction 

12 - Teacher initiated interaction 
Section 3 ^ Teacher receptivity to pupils ideas 

section 4 16 - Teacher dexterity with mathematics 

Buck then selected two teams of two observers each to test the ne 

instrument in several classrooms for observer agreement, structural 

weaknesses, and the general effectiveness of the instrument. He 

sent copies to a Jury of fifteen authorities, nine of whom replied 

to the inquiry. With near unanimity the respondents agreed that 

the behaviors contained in the OScAR {m) represented desirable 

„odem mathematics teaching practices for the elementary grades. 
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A general resume of the specialists’ comments revealed that 
(1) the instrument, if properly used, vould differentiate between 
V ,*cas types of teaching behavior, (2) it would have diagnostic 
value, and (3) it would establish a model for evaluating a xesson 
in mathemetics. Some of the specialists observed that the instru-> 
ment failed to identiiy teacher behaviors which caused pupils to 
assume responsibility for their own learning, that the instrument 
worked most effectively in a teacher-directed class, and that there 
was too little attention to the structure of mathematics and the 
interrelation of r-athematical ideas. As events turned out, however, 
the classes conducted by the teachers in Buck’s study were essen- 
tially teacher -dominated, and inclusion of more pupil-centered be- 
haviors would probably not have changed the final results of the 

study. 

After minor revisions were completed, the OScAR (EM) was 
duplicated and Buck began to prepare the observers to use it. The 
training period consisted of four three-hour sessions. Hie items 
on the instrument had been oded for secui'ity reasons, so it was 
necessary for the users to learn the meanings of the coded symbols. 
In the first training session the general use and interpretation of 
the new instrument was considered. The observers then listened for 
20 minutes to tapes of an actual mathematics lessons; in each of 
four five -minute intervals they checked items on one of the four 
sec^.ions of the OScAR (EM). The observers then compared their 
results, discussed their choices, and replayed the tapes. The 



oUservers reached approximately 85 per cent agreement on their 
independent observations during the training sessions. 

The OScAR (EM) had been divided into four sections . The 
observers considered only one section at a time, giving their full 
attention for five minutes to the items in that section. If a be- 
havior occurred vhich was listed in another section of the instru- 
ment that behavior was disregarded unless it occurred again during 
the time the appropriate section was in use. An item was scored 
only once during a visit, no matter how often it was repeated during 
the lesson. The observers rotated the four sections, beginning with 
a different one each time they visited a teacher. 

Buck then used the OScAR (EM) when he visited each of 28 
teachers ten times. These teachers were classified in two ways, by 
experience and by scores on mathematics achievement tests. Fourteen 
of the teachers had taught 15 or more years and fourteen had taught 
less than five years. Seven teachers in each experience classifi- 
cation made scores in the upper third of the distribution of achieve- 
ment test scores and seven made scores in the lower third. None of 
these teachers were enrolled in the television course. 

Sixteen of the l80 items were not checked at all during the 
280 visits in the preliminary study. Some of the items were checkea 
infreq.uently while others occurred during almost every visit. If 
an item appeared on less than 7 per cent or more than 90 per cent of 
the obser-.ation records, that item was not used. This decision was 
based on the assumption that behaviors v*ich occur too often or too 
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seldom will contribute little toward a study of differences between 
teachers. After eliminating both the infrequent and the too-frequent 

items, 43 items were left for further study. 

Since the observer either tallied an item or did not tally it, 
each of the 43 behaviors could be represented by the dichotomy of 
0 or 1. The relationship of dichotomous variables is found by com- 
puting phi coefficients and estimating the coefficient of correla- 
tion from a tetrachoric correlation table. The formula for computing 
the phi coefficients was: 

ad - be 

0 * ' 

V (a+b) (c+d) ^a*c) (bfd) 

Whenever the phi coefficient is interpreted as a coefficient of 
correlation, it should be recognized that such a coefficient is an 
underestimate of the correlation which would ensue if nijunerical 
values of each distribution were available.^ Therefore, the phi 
coefficient is adjusted by utilizing a conversion table of tetra- 
choric correlation from the phi coefficient. This entire process 
was accomplished by use of the 7074 TM computer at the Computation 
Center, The Pennsylvania S' .te University. The library program. 
Symmetric Phi Coefficient 11.2.001 by A. Wink, was used to prepare 

the da'ba. 

9 I James B. Wert, Charles Neidt and J. Stanley Ahmann, Statistical 
Methods in Educational and Psychological Research , New York: 
Appleton-Century-Crof ts , Inc., 195^> pag® 302. 



61 



Cooley and Lohnes (1962) explained the theory upon which 
factor analysis for principal components is based. 

The examination of the phi coefficients for principal com- 
ponents was accOTtplished by use of the library program. Principal 
components Analysis U.0.003, ty J- Cooley, V. laird, and L. Pryor, 
computation Center, The Pennsylvania State University. This pro- 
gram solves for the most dominant factors and ranks them according 
to the variance accounted for. In diis manner, eight factors were 

identified for use in the ctudy. 

Since the factors which would differentiate the variance 

among teachers were not readily discernible, they were analyzed 
further by the varimax rotation. "The emphasis in varimax is on 
cleaning up factors rather than variables. For each factor, varimax 
rotation tends to yield hi^ loadings for a few variables." The 
library program, Varimax Rotation 11.0.00*^ by J. Cooley and D. 
Thompson, computation Center, Ihe Pennsylvania State University was 



3 — T-I- TJOS nAoea aarv to find among the items considered usable under 

the' above selection criteria those which seemed to cl^ter 

If the investigator could identify items which were closely 

Z ^ch XX he could use them to scale the 

To determine Which, if any, items appeared to together tn 

efficients (from phi coefficient analysis) were subjected to fact 
efficients vriOTP components. "Principal components anal- 

\ta. domain can be combined to produce m^i^ several 

individuals along a single dimension, but of e n r - ^^ domain 

independent dimensions are required to define adequat y 
under investigation." 



used. This program performs an orthogonal rotation resulting in a 
matrix of factor loadings. Thus, factor analysis by varimax rota- 
tion brought the factors into sharper focus. 

Tables 5 through 12 show the scales developed from the eight 
factors with the items most closely identified with each. Since 
all of the kj items which were observed often enough to be used in 
the data showed their highest loading in one of eight factors. Buck 
assigned each of the ^3 items to the scale corresponding to the 
factor in which the highest loading occurred. He thus built ei^t 
scales for classifying observed teacher behavior. The name as- 
signed each of the eight scales seemed most descriptive of the 
cluster of items contained in that Scale. 

It must be pointed out here that the scales which Buck 
identified through factor analysis were derived solely from the 
280 visits made to the 28 teachers in his study. Most of these 
teachers were using methods which were acceptable in the geo- 
graphical and cultural region in which the study wa-. conducted. 

Buck made no effort to make a qualitative evaluation of any 
teacher's behavior; he simply recorded their activities and re- 
ported the frequency of occurrence. If this instrument should 
be used in another community, especially one with a different 
cultural background, the scales developed by Buck should pro- 
bably be reexamined before they are used. 

It would be difficult to use any of these scales to show 
that one set of teachers performed better or worse than another. 
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one Bight perhaps generalise from the liet of items on any scale 
that a teacher following such practices would he using desirable 
teaching techniques. Similarly, enpirical Judgment might indicate 
that the set of items on another scale are typical of negative or 
undesirable mathematics teaching behaviors. It was not the pur- 
pose of Buck’s study, however, to speculate on whether the per- 
formance of a set of teachers is good or bad; rather its purpose 
is to show changes in teaching strategies which followed one of 
the two kinds of treatment identified in the experimental plan. 



Tables 5-12 show Buck's eight scales of the OScAR (EM) aud 
the Items identified with each. 
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Table 5 

OScAR (EM) Items Identified With Scale 1 
Teacher Directing Strategies and Pupil Response 



Items 




Factor Loading 


1. 


Pupil agrees with teacher. 


.23 


2. 


Pupil offers hypothesis. 


.^5 


3. 


Teacher poses leading or 
structuring questions. 


.57 


k. 


Teacher rephrases or restructures 
pupil contribution. 


.55 


5. 


Teacher requests pupil to 
repeat contribution. 




6. 


Teacher applies logic to 
mathematical ideas. 


.56 


7. 


Teacher introduces concept 
throu^ problem. 


.32 


8. 


Teacher uses illustration. 


.63 


9. 


Teacher vises social application. 


.40 




Eigenvalue 


a. 866 
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Table 6 

OScAR (EM) Items Identified With Scale 2 
Pupil-Teacher Interaction 



Items 




Factor Loading 


1. 


Pupil gives verbal assistance 
to another pupil. 


-.68 


2. 


Pupil expresses disagreement 
with teacher. 


..56 


3. 


Teacher allows pupil choice 
of solution. 


..25 


k. 


Teacher interrelates mathematical 
ideas . 


-.42 




Eigenvalue 


1.990 


Table T 

OScAR (EM) Items Identified With Scale 3 
Teacher Vocabulary Emphasis 


Items 


Factor Loading 


1. 


Decimal 


-.19 


2. 


Number 


-.34 


3. 


Numeral 


-.61 


k. 


Zero 


-.52 


5. 


Divide 


-.31 


6. 


Regrouping 


-.42 


T. 


Teacher uses Blackboard 


-.51 




Eigenvalue 


1.868 
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Table 8 

OScAR (EM) Items Identified With Scale 
ClassrocMn Discussion Strategies 


k 


Items 


Factor Loading 


1 . Pupil offers possible solution. 


-.27 


2 . Pupil volunteers pertinent 
information. 


-.35 


3 . Teacher asks pupil to illustrate 
answer. 


-.Wf 


k. Teacher locates key contributor 
and calls on him. 


-.30 


5 . Teacher waits for pupil to formulate 
answer. 




6 . Teacher uses mathematical rule 
or principle. 


-.51 


Eigenvalue 


1.722 


Table 9 

OScAR (EI^) Items Identified With Scale 
Teacher Motivating Behavior 


5 


Items 


Factor Loading 


1 . Sum 


-.51 


2 . Teacher uses environmental object. 


-.29 


3. Teacher encourages alternate solution. 


-.36 


Teacher adds enrichment for pupils. 


-.42 


5. Teacher develops rule or formula for 
procedure . 


-.57 


6 . Teacher questions correct answer. 


-.31 


Eigenvalue 


1.601 
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Table 10 ^ 

OSCAR (EM) IteiiB Identified Wito 
Classroom Interaction in Problem S 



Factor loading 



Items 



1. Pupil computes on chalkboard. 



2. Teacher asks pupil how he solved 
problem. 



-.30 

-.26 



3, Teacher refers statement or question 
to another pupil. 



4. Teacher makes reproving remark. 



-.32 

-.20 



5. Teacher accepts solution without 
comment . 



-.16 




Table 11 

OSCAR (EM) Items Identified With Scale 7 
Teacher Vocabulary Reference to Fundamental Ope 



Factor Loading 



Items 



1. Add 



2. Multiply 



3 , Remainder 

4. Subtract 



-.69 

-.35 

-.35 

-.43 



Eigenvalue 



1.483 
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Table 12 

OScAR (EM) Items Identified With Scale 8 
Information Seeking by Pupils 



Items 




Communal! ti es 


Factor Loading 


1. 


Pupil requests more 


information. .25 


- .39 


2. 


Pupil seeks teacher' 


'8 help. *39 


- .60 






Eigenvalue 


1.U66 



Stability of t^ Scales . After identifying the ei^t scales through 
varimax rotation as described above, Buck examined each of them for 
estimates of stability. These estimcites of stability were computed 
by analysis of variance using a one-factor repeated measurement 
(Type I Lindquist)^ design. This is a design of one within-sub^ect 
dimension (dimension A) and one between-subject dimension (dimension 
B). In such a design "b” repetitions represent the total number of 
treatment group 3 in the B dimension. The model for examining the 
data may be viewed as B representing teachers, A items and visits 
as "b” repetitions. Visits are nested under teachers with teachers 
and visits considered random and items fixed. Lindquist pointed 
out that the Type I design can be applied when observations are 



12. E. F. Lindquist, Design and Analysis of Experiments ^ 
chology and Education , (Boston: Houghton Mifflin Company, 1953) ^ 
page 2b7“ 

13 . Ibid., page 2T3* 



taken at regular or stated intervals and the intervals are the same. 
The machine programs for One-faetor Repeated Measurements mVA 
(Type I) vas vritten hy Charles Spiker^*^ M adapted for use on the 

707 ^ IBM computer by Francis J. Di Vesta. 

A schematic model is shown in Appendix E. For each OScAR (M) 
scale the model varies according to the number of items of behavior. 

The estimated reliability coefficients represent the cor- 
relation between scores based on observations made by different ob- 
servers at different times. Table 13 contains the reliability co- 
efficients for each of the eight OScAR (EM) Scales. 

Table 13 

Reliability Coefficients for OScAR (EM) Scales 



Scales 



pxx 



1 . Teacher Directing Strategies and Pupil Response 

2 . Pupil-Teacher Interaction 

3 . Teacher Vocabulary Emphasis 

!(., Classroom Discussion Strategies 

5. Teacher Motivating Behavior 

6. Classroom Interaction in Problem, Solving 

7. Teacher Vocabulary Related to Fundamental 
Operations 



8 . Information Seeking by Pupils 



. 7 ^ 

.70 

.71 

.70 

.72 

.69 

.90 

.68 



TTI hne.factor Repeated Measurements WO W (Type l) 

^;ecS^rinstffi o^nOihS^ Of 









Uie rellafeUity coefficient vas defined as r » where tx 
represented the variance of true scores around the mean. (X^ re- 
presented the variance of the obtained scores of all teachers in 
the population around their mean.^^ In estimating the reliability 
coefficients with a nesting classification r^^ was defined as a 
true score of ttie nested parameter divided by the true score plus 
the error term. Ibis procedure estiiiiated the reliability co- 
efficient for each scale. The reliability coefficients listed in 
Table 13 show that the scales were consistent in identifying certain 
elements of teacher behavior when successive visits were made to the 

same teacher's classrooms. 

correlations Between Scales . The correlations between the teachers ■ 
scores on the el^t scales give some evidence of the independence 
Of the scales. Table l4 shows these correlations. 



T? iDonald STMedley and Harold E. Mitzel, "Measuring Classroom 

Behavior by Systematic Observation, " Handbook of Resear^ ^ 
Teaching, American Educational Research Association, Rand McNal y, 

Chicago, 1963 , pag« 310. 



Table / \ -i 

Interoorrelations Among the Bight OScAR (®) Scales 



1, Teacher Directing 
Strategies 

2, Pupil Teacher 
Interaction 

3 , Teacher Vocabulary 
Emphasis 

k. Classroom Interaction 
Strategies 

5 . Teacher Motivating 
Behavior 

6 . Classroom Interaction 
in Problem Solving 

7 . Teacher Reference to 
Fundamental Operations 

8 . Information Seeking 
by Pupil 



2PTI 


3 TVE 


kcis 




6CIPS 


7TRF0 


8lsp 


.29 


. 3 ^ 


.37 


.29 


.33 




.26 




.39 


.11 


.53 


.19 


.18 


.12 






-.16 


.67 


-.02 


.42 


.33 








.Ok 


.28 


.25 


-.10 










.09 


.30 


.18 












1 

• 

0 

H 


-.35 














.29 



The ei^t OSCAR (EM) scs.l»B developed by Buck should have been in- 
dependent of each other because they were selected from a principal 
components analysis. Buck, nevertheless, computed the correlations 
between the scales and reported them as shown in Table Ik. With two 
exceptions (Scale 5 with Scale 2 and Scale 3) all correlations were 
low. Although B.»ck could not account for these exceptions, he con- 
eluded that, in general, the scales did operate independently of 

each other. 
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DlBcrimlnatlon Between Teachers . To say that the OScAR (EM) scales 



are stable dimension of teacher behavior does not infer that they 
discriminate between teachers. Buck made further analysis of the 
scales to determine whether greater than chance differences existed 
between scores assigned to teachers by observers visiting their 
classrooms. He used a single classification analysis of variance, 
AOVD, 11 . 5.009 by Richard Craig of the Computation Center, The 
Pennsylvania State University, for examining these differences among 
teachers. The resulting F. Ratios are found in Table 15 . 



Table 15 

F Ratios for OScAR (EM) Scales 



Scale 


F Ratio 


Probability (32 and 297 DF) 


1 


5^55 


< .01 


2 


1.78 


h 

• 

0 


3 


2.90 


< .01 


k 


2.31 


< .01 


5 


2.07 


< .01 


6 


1.64 


< .05 


7 


2.30 


< .01 


8 


1.83 


<.01 



Buck interpreted the data in Table I 5 to mean that the scales 
discriminated between teachers regardless of the time of the visit 
or the identity of the observer. 



Appendix C 

Pre- and Post Test Scores on Two Tests 
of Mathematics Achievement 



Table l6. Pre- and Post-Test Scores on Two Tests of Mathematics 
~ Achievement by Experimental and Control Teachers 
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The score on the Principles Test was 68 ; on the Vocahulary Test 60 vas the highest score 



